What Is Claimed Is: 



/ 1. A method of motion estimation and compensation processing, comprising: 

2 determining a preliminary motion vector from a set of partial motion 

3 vectors each associated with a corresponding subsampled 

4 matchblock representing a given picture; 

5 generating a second motion vector based on a refined granularity of the 

6 preliminary motion vector; and 

7 performing a fractional pixel search using the second motion vector to 

8 produce a final motion vector, the final motion vector being used 

9 for motion compensation. 

y 2. The method of motion estimation and compensation processing according to 

2 Claim 1, wherein determining a preliminary motion vector, comprises: 

3 dividing the matchblock associated with the given picture into a plurality 

4 of first sub-blocks; 

5 dividing a search area associated with a reference picture into a plurality 

6 of second sub-blocks, the second sub-blocks being divided by a 

7 factor similar to that used to divide the first sub-blocks; 
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8 duplicating one of the first sub-blocks over each of the second sub-blocks; 

9 and 

10 determining a set of best matches between a respective sub-image in each 

n of the first sub-blocks and a sub-image in each corresponding one 

12 of the second sub-blocks, the set of best matches representing the 

13 set of partial motion vectors. 

1 3. The method of motion estimation and compensation processing according to 



2 Claim 2, wherein the first sub-blocks each comprises a Q x Q array of pixels subsampled 

. 3 from the matchblock, and the second sub-blocks each comprises an M x M array of 

P 

m 4 pixels. 

ru 

3:1 

P> / 4. The method of motion estimation and compensation processing according to 

w 

J| 2 Claim 3, wherein M = 16 and Q = 4. 

££} i 5. The method of motion estimation and compensation processing according to 

a 

W 2 Claim 3, wherein Q = 19 for bidirectionally predicted coded (P-type) pictures that are in 

Q 

f,i¥ 3 sequence previous to and subsequent to the reference picture. 

/ 6. The method of motion estimation and compensation processing according to 

2 Claim 3, wherein Q = 19 for left and right portions of the given picture, when in a 

3 predicted coded (P-type) format. 

/ 7. The method of motion estimation and compensation processing according to 

2 Claim 2, wherein determining a set of best matches comprises: 
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performing exhaustive searches in parallel for each of the first sub-blocks 
over each respect one of the second sub-blocks. 

8. The method of motion estimation and compensation processing according to 
Claim 7, wherein performing exhaustive searches in parallel comprises: 

calculating a partial sum of absolute distance (Psad) between coordinate 
positions of one first sub-block and a corresponding one of the 
second sub-blocks. 

9. The method of motion estimation and compensation processing according to 
Claim 8, wherein the Psad is determined from 

Psadi i = 2 | match n - ref i j | , 

ij = o„r 

wherein i represents an x coordinate position, j represents a y coordinate position, matchi j 
represents a first sub-block, and refj j represents a second sub-block. 

10. The method of motion estimation and compensation processing according to 
Claim 7, wherein performing exhaustive searches in parallel comprises: 

contemporaneously moving each of the second sub-blocks relative to each 
corresponding first sub-block to a next location; and 

calculating a partial sum of absolute distance (Psad) between coordinate 
positions of one first sub-block and a corresponding one of the 
second sub-blocks. 

1 1 . The method of motion estimation and compensation processing according to 
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2 Claim 1, wherein generating a second motion vector based on a refined granularity of the 

3 preliminary motion vector, comprises: 

4 obtaining the matchblock associated with the given picture; 

5 enlarging a first search area to generate a second search area, the first 

6 search area being associated with a reference picture and used to 

7 determine the set of partial motion vectors; and 

8 determining a best match between a respective sub-image located in the 

9 matchblock and a sub-image that is identical to the respective sub- 
10 image and that is located in the second search area, the best match 

^ n representing the second motion vector. 

3 

fU 

s ;:: i 12. The method of motion estimation and compensation processing according to 

a 

Si 2 Claim 1 1 , wherein determining a best match comprises: 

3 3 performing an exhaustive search for the respective sub-image over the 

s 

^! 4 second search area. 

D 

M 

J v> i 13. The method of motion estimation and compensation processing according to 

2 Claim 12, wherein performing an exhaustive search, comprises: 

3 calculating a partial sum of absolute distance (Psad) between a coordinate 

4 position associated with the matchblock and a corresponding 

5 coordinate position associated with the second search area. 

1 14. The method of motion estimation and compensation processing according to 

2 Claim 13, wherein the Psad is determined from 
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3 Psadj j = Z | match jj - ref y | , 

4 M' 0 - 3 

5 wherein i represents an x coordinate position, j represents a y coordinate position, matchj j 

6 represents the matchblock, and ref jj represents the second search area. 

1 15. The method of motion estimation and compensation processing according to 

2 Claim 13, wherein performing an exhaustive search, comprises: 

3 for each coordinate position associated with the matchblock, calculating a 

4 partial sum of absolute distance (Psad) between each said 

5 coordinate position and all coordinate positions associated with the 
0 6 second search area. 

1 5;j i 16. The method of motion estimation and compensation processing according to 



si 
£0 



2 Claim 1 1 , wherein the matchblock comprises an M x M array of pixels, the first search 

3 area comprises a Q x Q array of pixels, and the second search area comprises an Q+2 x 

4 Q+2 array of pixels, where Q a M/4. 

/ 17. The method of motion estimation and compensation processing according to 

2 Claim 16, wherein M = 16 and Q = 4. 

/ 18. The method of motion estimation and compensation processing according to 

2 Claim 1, wherein performing a fractional pixel search using the second motion vector to 

3 produce a final motion vector, comprises: 

4 obtaining the matchblock associated with the given picture; 

5 enlarging a first search area to generate a second search area, the first 
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6 search area being associated with a reference picture and used to 

7 determine the second motion vector; 

8 determining a half-pixel predicted reference macroblock associated with 

9 the second search area; and 

10 determining a best match between a respective sub-image located in the 

u matchblock and a sub-image that is identical to the respective sub- 

12 image and that is located in the second search area, the best match 

13 representing the second motion vector. 

„„ : i 19. The method of motion estimation and compensation processing according to 

y 

J!j 2 Claim 1 8, wherein determining a best match comprises: 

iu 

$ 3 performing an exhaustive search for the respective sub-image over the 

Q 

Sj 4 second search area. 

a 

0 1 20. The method of motion estimation and compensation processing according to 

m 

P 2 Claim 19, wherein performing an exhaustive search, comprises: 

V* 3 calculating a partial sum of absolute distance (Psad) between a coordinate 

4 position associated with the macroblock and a corresponding 

5 coordinate position associated with the second search area. 

/ 21. The method of motion estimation and compensation processing according to 

2 Claim 20, wherein the Psad is determined from 

3 Psady = £ | match ^ - ref j j | , 

4 ij = 0..^ 
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5 wherein i represents an x coordinate position, j represents a y coordinate position, matchj j 

6 represents the matchblock, and ref j j represents the second search area. 

/ 22. The method of motion estimation and compensation processing according to 

2 Claim 19, wherein performing an exhaustive search, comprises: 

3 for each coordinate position associated with the macroblock, calculating a 

4 partial sum of absolute distance (Psad) between each said 

5 coordinate position and all coordinate positions associated with the 

6 second search area. 

^ i 23. The method of motion estimation and compensation processing according to 

p j 2 Claim 18, wherein the matchblock comprises a 16 x 16 array of pixels, the first search 

f*j 3 area comprises a 4 x 4 array of pixels, and the second search area comprises a 18 x 18 

M 

i$ 4 array of pixels. 

CJ 

CO / 24. The method of motion estimation and compensation processing according to 

p 

2 Claim 1, further comprising: 

P 

3 ! 

^ 1 3 determining residual data associated with the final motion vector; and 

4 reconstructing a video signal for encoding based on the residual data and 

5 the final motion vector. 

/ 25. The method of motion estimation and compensation processing according to 

2 Claim 24, wherein determining residual data (residuey) associated with the final motion 

3 vector, comprises: 
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4 determining match data (matchjj) for Y, U, and V components of the given 

5 picture; and 

6 calculating prediction data (predj j) of a reference macroblock (refj j) 

7 associated with a half pixel search. 

/ 26. The method of motion estimation and compensation processing according to 

2 Claim 25, wherein the predj j is determined according to 

3 predi j = 

4 (refij + refij.i4-l)»l;or 

5 (refjj + refij+i + 1) » 1 ; or 

6 (refjj + refj.i j + 1) » 1 ; or 
0 7 (ref;j + ref; +l jH-l)>>l;or 

J 8 (refjj + refij.i + refj.i j + ref M j-i + 2) » 2; or 

j:l 9 (refij + refij-i + ref i+ i j + refj+i j-i + 2) » 2; or 

I'll io (refjj + refjj+i + ref i+ i j + ref i+ i j+i + 2) » 2; or 

II (refjj + refjj+i + refj.i j + refj.i j+i + 2) » 2, 

H 12 

^ 13 wherein i represents an x coordinate position and j represents a y coordinate 

b 

II I 14 position of the reference macroblock. 

Cj 

1 27. The method of motion estimation and compensation processing according to 

2 Claim 26, wherein the residual data is determined by 

3 residue j = match j j - pred jj 

4 U = 0..15 

1 28. The method of motion estimation and compensation processing according to 

2 Claim 27, wherein reconstructing a video signal for encoding based on the residual data 

3 and the final motion vector, comprises reconstructing the macroblock data according to 

4 reconstructed j = residue j j - pred j j . 
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ij = 0.15 

/ 29. The method of motion estimation and compensation processing according to 

2 Claim 27, wherein reconstructing a video signal for encoding based on the residual data 

3 and the final motion vector, comprises performing decompensation to reconstruct the 

4 macroblock data based on the residue data and the prediction data. 

1 30. A computer-implemented method of motion estimation processing, 

2 comprising: 

3 dividing a matchblock of a current frame into a plurality of sub- 

r*j 

I* 4 matchblocks, the current frame to be encoded; 

%*\> 

f t j 5 dividing a first search area of a reference frame into a plurality of search 

Q 6 sub-blocks; 

N 

^1 7 replicating a sub-matchblock over each of the search sub-blocks; 



H 8 performing partial pixel level searching in parallel of each sub-matchblock 

f*i 

r v \ 9 replicated over the search sub-blocks to generate a preliminary 

w motion vector; 

11 modifying the first search area to produce a second search area; 

12 performing full pixel level searching of the matchblock over the second 

13 search area to generate a second motion vector, the second motion 

14 vector being of finer granularity than the preliminary motion 

15 vector; and 

16 performing half pixel searching on the second motion vector to produce a 
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final motion vector used for motion compensation. 

3 1 . The computer-implemented method of motion estimation processing 
according to Claim 30, further comprising: 

determining residual data and prediction data associated with the final 

motion vector; and 
reconstructing a video signal for encoding based on the residual data and 

the prediction data. 

32. A video compression system, comprising: 

a processor-based platform coupled to a bus subsystem; and 

coupled to bus subsystem, a front end subsystem having at least a motion 

estimation and compensation (MEC) engine coupled to a stream 

buffer. 

33. The video compression system according to Claim 32, wherein the MEC 
engine includes: 

an A x B array formed from a plurality of cells coupled to a set of 
controllers and an end column processor. 

34. The video compression system according to Claim 33, wherein the A x B 
array includes: 

a M x N sub-array of p_cells; and 

coupled to the p_cells, a plurality of boundary cells bounding the M x N 
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5 sub-array. 

/ 35. The video compression system according to Claim 34, wherein the boundary 

2 cells include: 

3 a plurality of updo wn cells disposed along a first set of opposing sides of 

4 the M x N sub-array of p_cells; 

5 a plurality of io cells facing a plurality of column cells, the io cells 

6 disposed along one side of a second set of opposing sides of the M 

7 x N sub-array of p_cells, and the column cells disposed along the 

8 other side of the second set of opposing sides of the M x N sub- 

, ? ; i 

% 9 array of p_cells; and 
fli 

Ijjl; io a plurality of corner cells coupled to the updown cells. 

0 

k ? ! j i 36. The video compression system according to Claim 35, wherein N = 5, and M 



CO 



p 

13 



2 = 20, A = 7, and B = 22. 

/ 37. The video compression system according to Claim 33, wherein the set of 

2 controllers includes an x-controller and a y-controller each having respective control lines 

3 coupled to the MEC array to form an MIMD arrangement. 

/ 38. The video compression system according to Claim 33, wherein the end 

2 column processor receives output signals from the MEC array. 

/ 39. The video compression system according to Claim 32, wherein said system is 

2 included in one of a PC camera, digital camera, personal digital assistant (PDA), 
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3 multimedia cellular mobile phone, digital video recorder (DVR), and multimedia device 

4 and appliance. 

1 40. The video compression system according to Claim 32, wherein said system is 

2 included in one of an SoC and an ASIC applications. 

1 41 . A computer program product for motion estimation and compensation, the 

2 computer program product stored on a computer readable medium, and adapted to 

3 perform operations of: 

4 determining a preliminary motion vector from a set of partial motion 

5 vectors each associated with a corresponding subsampled 

6 matchblock representing a given picture; 

7 generating a second motion vector based on a refined granularity of the 

8 preliminary motion vector; and 

9 performing a fractional pixel search using the second motion vector to 
w produce a final motion vector, the final motion vector being used 
11 for motion compensation. 

1 42. A computer program product for video compression processing, the computer 

2 program product stored on a computer readable medium, and adapted to perform 

3 operations of: 

4 dividing a matchblock of a current frame into a plurality of sub- 

5 matchblocks, the current frame to be encoded; 

6 dividing a first search area of a reference frame into a plurality of search 
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7 sub-blocks; 

8 replicating a sub-matchblock over each of the search sub-blocks; 

9 performing partial pixel level searching in parallel of the sub-matchblocks 
io replicated over the search sub-blocks to generate a preliminary 

n motion vector; 

12 modifying the first search area to produce a second search area; 

13 performing full pixel level searching of the matchblock over the second 

14 search area to generate a second motion vector, the second motion 

15 vector being of finer granularity than the preliminary motion 

16 vector; and 

17 performing half pixel searching on the second motion vector to produce a 

18 final motion vector used for motion compensation. 

1 43. A video processing system providing motion compensation, comprising: 

2 means for determining a preliminary motion vector from a set of partial 

3 motion vectors each associated with a corresponding subsampled 

4 matchblock representing a given picture; 

5 coupled to the means for determining, means for generating a second 

6 motion vector based on a refined granularity of the preliminary 

7 motion vector; and 

8 coupled to the means for generating, means for performing a fractional 

9 pixel search using the second motion vector to produce a final 
w motion vector, the final motion vector being used for motion 
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u compensation. 

1 44. The video processing system according to Claim 43, wherein the means for 

2 determining a preliminary motion vector, comprises: 

3 means for dividing the matchblock associated with the given picture into a 

4 plurality of first sub-blocks; 

5 means for dividing a search area associated with a reference picture into a 

6 plurality of second sub-blocks, the second sub-blocks being 

7 divided by a factor similar to that used to divide the first sub- 

8 blocks; 

q 

9 means for duplicating one of the first sub-blocks over each of the second 

\3 
f\\ 

"Si io sub-blocks; and 

V\ 

^ | 11 means for determining a set of best matches between a respective sub- 

i 

s 12 image in each of the first sub-blocks and a sub-image in each 

f * 

C6 13 corresponding one of the second sub-blocks, the set of best 

4 14 matches representing the set of partial motion vectors. 



1 45. The video processing system according to Claim 43, wherein the means for 

2 generating a second motion vector based on a refined granularity of the preliminary 

3 motion vector, comprises: 

4 means for obtaining the matchblock associated with the given picture; 

5 means for enlarging a first search area to generate a second search area, 

6 the first search area being associated with a reference picture and 
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7 




used to determine the set of partial motion vectors; and 


8 




means for determining a best match between a respective sub-image 


9 




located in ine maicnoiocK ano a suo-image max is laeniicai 10 me 


10 




respective sub-image and that is located in the second search area, 


11 




the best match representing the second motion vector. 


1 


46. The video processing system according to Claim 43, wherein the means for 


• 2 


performing a 


fractional pixel search using the second motion vector to produce a final 


3 


motion vector, comprises: 


4 




means for obtaining the matchblock associated with the given picture; 


| 5 




means for enlarging a first search area to generate a second search area, 


s* 6 




the first search area being associated with a reference picture and 


?H 

\! 7 




used to determine the second motion vector; 


as 

s 8 

0. 




means for determining a half-pixel predicted reference macroblock 


m 9 




associated with the second search area; and 


0 




means for determining a best match between a respective sub-image 
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located in the matchblock and a sub-image that is identical to the 


12 




respective sub-image and that is located in the second search area, 


13 




the best match representing the second motion vector. 


1 


47. A video processing system capable of providing motion compensation, 


2 


comprising: 




3 




array means for processing data received from memory means to 
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determine a motion vector; 
coupled to the array means, means for selectively controlling the array 

means to enable processing of the data received; and 
coupled to the array means, end column means for obtaining the motion 

vector from the array means to enable motion compensation. 
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